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(54) DEVICE AND METHOD FOR PROCESSING IMAGE SIGNAL 

(57)Abstract: 

PROBLEM TO BE SOLVED: To provide a still image of 
high resolution from a plurality of image signals even 
when a dark object is photographed by a hand-held 
digital camera. 

SOLUTION: The image of an object passing through a 
lens group 1 not provided with an optical axis variable 
element is supplied to a CCD image pickup element 2 
while a shutter 10 is pressed. At this moment, the image 
is picked up at a shutter speed of 1/1000 sec. The 
picked up image is supplied to an image processing 
circuit 3. In the image processing circuit 3, cylinder 
conversion, conversion of optical axis direction and the 
aligning of 1/m pixel accuracy are executed to the image 
signals, the resultant images are stored in an image 
memory 4 and a plurality of photographed image signals are successively added in real time 
while aligning reference image signals and present image signals. In a compression circuit 5, 
compression is executed to supplied synthetic image signals. Further, compressed image 
signals to which sub data are added are supplied to a recording medium 6. 
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im^mi] -^^y^'Srjf L-cv^sRu. ^n<r>mm 

¥iS^^:$i^fc±IEii^ife%R18^^^&3^^ffi'^3E«|-r5jS»3Ei^i 



Ctl*^ 1 0 1 fS*3S 1 5 ^ct^v^T, 

[»*«i2] ii»*^i*fcMt5»c*jv>T:. 

[f|3^« 1 3 1 y Srif U-CV>SM» ^mtitos^ 

ixfc±ISiii«l*¥ffij!>> e> RfS'^SEIfe-r 5 y 7' 

R1§i^ft$lxfc±fSli^<o§q««]Ei:. Rffi^ftSHfc 

¥*&{b$nfc±EH»*R1S5d»e.¥ffi'^3E»i-5;^f^ y 
«5Hrt©(ftBi*lxSr*-r«li«t<Dffl-e, l/mmmo) 
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[0 0 0 1 1 
[0 0 0 2] 

m^o&m] affix »Jl:E*-KSr*-r5*;>'7-f*: 
[0 0 0 3] 

■t-•5i:#lcfc^5^©-l»03tL*^JfflU-CV^^i:v^. JErO 
fcfe, y'-i--:7<?/W;<7y7T?»|^$tvfc»ihBtt, S/N 

[0004] $ ?) ic. moBfiafi^i&^fife-t-s i ^ 
[0 0 0 5] #i$t>rof*-fi^^yv*;^ 9 

«:oTV>«, l/l 0 Osec (Oi^^y frmSii^ 

ifJ-S/iggS^cDa^ftrSrTK^H^ISS (TELE® © 

1 0msec r'S)5, lj|6ro*¥li^fcSr 6 4 OB^ (V 
GA (Video Graphics Array) ffiS) ti-Htf, 1*S 
fct)cOH^^I4. 6 4 0/5 = 1 2 Sa^r-foS, t¥o 
r, 10msec»K(C, 0. iSSlV^fcfc'l^feO. IX 
12 8 = 12. 81i*©Sn«r*CTU*5BaH!iSji)o 

[0 0 0 7] ^rr-c. ro^?g©s6^(4. #it*>-e»ti/^ 

[0 0 0 8] 

[SliHSr^Sti- Sfc»©#ii] S»*qjl tcffi«(D|il?g 

nm(om\>-^mmmx'm^^m&:^^-t^Wim'Ft, 



m^'p. mmmikt. ±.mmmmmcMLxw\^<D^m 

[0 00 9] il*JS 5 icWM<Dmmii. i^-t y ^ trff L 

±mmmmm^MLxm^<ovim^<D^mirtii:^ 

[0 0 10] K^^l 3»Cl2«®^?gtt, V^5':J'Sr}¥ 
i:. «^$ixitB«lSr¥ffi/5^5>nff--^«|-rS:=^7^y7' 

f>^<Di<Lm-rti^^i-?>m^t(Dmx\ i /mmm<Dms. 
iitzmm^mm-r^^^'ry^t. i^^y^^m-tt. *n 

St^n;fcB#Sr*P»bfctfe^r-K5»L., ¥mt-r^>^T 
[0011] 1 4 {c|2«05IW»4> 'y^ y 9 ^Srjf 

rt©ta:m-fixS:*1-SB»i:<0K-C, l/mH^©aS 

|cC^i:-CB^^SrffijE-r5;^x-^:/t. ag-fn!65«jE$ 
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5, 

[0 0 1 21 affiWlC^it*>Or-<5^i?/V'*^7<^lR)# 
i^lrs'^'i^Srl/l OOOsec t LT. SScft 

(0 0 131 

t*i^(o*it(Djgffii SIT. :i(omm<ommmmi^^\>^ 

[00141 CCDm^^2-ej4, S^fr!i)^5>roAlt 
3fc«5«?i(fi:UT»i«Six5. CCD«|fe3(ST-2tt. V;^ 

y 4lc:Stt$tv5c, 

[0 0 151 H^iaaiHiK 3 r-tt, ^)$f'5J;5i-. ii 
®^^y 4'-tti^^?ti,5o 

(0 0 161 H^P<^U 4l;|E^^tnfc^figli^ffi^ 
fi^ ffiiffilHlK5tcJ;oTffiil8*a!aijS*$tt5. -^irL, 
X. »JtiiitLTIB»$nfc^jaiii«!fllf-K*rUTJP 
EG (Joint Photographic Experts Group) ip^^fl 



(0 0 171 ■^^y'-^umta^itltrnmiSiim^ti. 

[0 0 181 aif^^-**»e>oJiSlwjE£:Dfcv:^3V9 
©»J«UiJ:o-c, IB»S«fr6d»6ffiHgiii«ift#!9SR*t« 

[0 0 191 ±aufcli«;<*y 4(i, «IS:(DH«ffi^ 

[0 0 2 01 ±3^L.fcuvXpUc(l, 3t$ft©:;^iB)Sr^ 

[002 11 »JhBJ::*3(tS^H®]^»tt. Si^fr-JJ 

V'xOt?. $iaifRgjS(C7i?>)'<fV\ 0il;ttf. 1/lOOse 

tir. ^IxSrl/l 0^c6)lSL,fc^^#g•, roHJSJi^ 
*-f->+y^3i*S:l Of&roi/l OOOsec 
{CS;SL-Ct^-Y 5' ^'^Ki? 2 9 2f}>F^}f UiggitTA^e) 

»t, -r5t:iro2?j'ia(c:, eo^nmm^a^imi 
^nm/i o{;ifl]x?jix-cv^5. L*^L/fi5tj. a 

^r^-e, 6 0tfe(^)#B^«^lc*fU-C5^a«iE 
SrJS 1/1 B*®««~ 1 / 8 B*ro»«-effifll^ 

[00221 H«(t#«rlgJ^i-«f^ 1 fc LT, It 

^d^^^ya 9*5jf J^^•c^^5rav i/i o o osec <De/ 
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1 / 1 0 0 0 sec (Diy^ y ^SS-C®«ft-^4:*^ LiK 

ffiE-g-b*, ^mimmid^xfMm^mi:Mu s/n 

tt-CVSW. 1/1 0 0 Osec 

[0 0 2 3] rr-C. ±3iLfcB§fe*aa[HlK3«rg]2Sr 
CCDm^^2!ei-e)»i^$*v.5Htfe 

LT, /<S'7T;^*y 2 StCfi, 17W'-Atf>S!it« 

[0 0 2 41 ttBftfflllIgS2 4-ett, l^W-AWS* 

m^hfi^o C(OfiB«IUI§]fS2 4tt, t2;:»;M^|Hlig2 
g[pI8S2 8*^P>«)^$H5, 

[0 0 2 5] r©-0!|t?li. /^s'^rp'^y 2 SJCtt. 

tLx{tm.^mi^m^btii>o ^(oxoic. mmm^m 
m^iii&mm^m^ti.x^m^h^, tLx. -t© 

[0 0 2 6] mSlfeffi^tt, i£:feffi^lHlK2 S'^fiti^^ 

ii, mimmm^ni. ti±m^m9i2 7'>.«i^$n«o 

fSl«»*siS $ *t-fc®filflr#-6S 1 »~ 8 |»-4t:*: $ 
tit. /^$^^:/^y^'S(c^^la^|r^T5<or^ J£:*:«Pfl(Hl 

gS2 5{4, f— 9^«ifflSr!ii>lli:i-5fc*Sfc:^ffir^lHl8S2 



7 i 9 l£v>f--i' XiSjgjg-eS)5. CWfe:>cMMlHl8S 2 5 
*3j:t;t2 7-Ci±, ftiteJtifcSi^ffi^SrRffiSlftUfc 

K2 6-tti^$H5<, 
(0 0 2 7] :/ny:?fe(©fire^ttJI51K2 IH 
^Wl/l~l/8 0»*-C7't3 y ^' ft©(4gAS«IUl $ 

;^VaSrtf»U /^y r^-xiS/h^t-'ttf^iUs -to:/ 
V a ©tfflttt. 

Va=2 (yi 2 ) /K- (Z (yi /K) ) ^ 
mU yi K :-foyi7fy<Dmm^ti-^^ 

02{C^-rJ:5»-^liSS-fei'f-2 9«5fe5#^. 

*©:^i^*-ti^-y-2 9 -e«^ffl$ti5»f t^©3t$ft©;^i^ 
©S<WHsl:g«IUllHlgS2 6--tt*&$*v5i:, 

[0028] feaK^lUK 2 8 r-li, :/n y i 

^l!bhix1tim\^(Dmt^Ws^^^y [i] i L. 

^3o-^mm$tii>. *aaia©iiiii52 8-e«iffl$ 

[0 0 2 9] B*-ff>L«^|5]K3 0-ett, 
/jN»^5>IC5S:CT/<y7r^*y 2 3;J»?,lliift»f?$h, 

mm^*.w-:^{^i^irtix\,^itmm^intcm^. c©® 
ig-f b iMmmK 3 0 {iji. fietfewiHiK 2 4 d»f>/MS 

fiE^^©0. 7d5««&$n5o ^rif. H*-f P>L.#WlH] 
gS3 0-^t±, SBaT*SlcJ;o-C, ®l||A*»e>H^B©:J^ 
lRl-0. 7B^-ftlfcfigfcH^CdSt^$4x5. C© 

AX (1-0. 7) +BXO. 7=C 

m&^^\cMvxo. 7mm-rb{.i)m$ii. 0. 7® 
$ixfcB»(B#-tt> mm-f b Lmmm^ 3 0 ii^bmm^ 

[0030] B^XJ^IiiaS 3 1 -Ctt. «i^$ixfcB«^ 

immcmii'X. mm-fbLmsim^titzmmm^-iz 
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B§fe^Jg|51IS3 l/i»t>JDfi[|HlK3 2-^«i^$tv5, 

[0 0 3 1] Jd»Ih1K3 2-e(4. ffl;^;ii^p(^-y 3 3d» 

3. 7m^^7ii^^fiiK-rinx\,^^tmV(^htzm^^ 
:i<Dtiit}mm.?^ ^ y 3 3 ten*. -egMfflEK 2 4 *^e>iF 

ISfig^^(0 3*stt)f&$ix5, ^rcoSS:fie5>W3®-ftuSr« 
jE-f 5 ± 5 1 . * y 3 3 -ctt. *5p:J^i^'^ 3 

•r«i3*>. s^-fe>u«raiHiiS3 0T-o. 7H«f 

e>$tb. roffl;^7iS«p«*y 3 3f31i^-f e>^?*i-5, 
lcAD»lHlK3 2-CAdS$*v5, 

y 3 3 coissif-^' c c Drnvkm^ 2 ©s^sois 

[0033] C <0-fi^t?J4, 2 iJ>-e 6 0 ft Wiflft^S-^© 
m;t>H»P<*y 3 3tt, 1 4 1^-;/ h(DVGAM»jC 

®ft^{4> W;'3lifiKp<*y 3 3*»e>Apj||iIIS3 2*JJ:0t 
|SSf^IlIK3 4'-«^^?n.5, 
[0 0 3 4] 1^0883 4-ett, nmaM-^tltz-^fm 

its ±T&:^\Cy'Hi^^/\^i3;t7^m^Ltttif3m¥ 

Lrvsto-c. W;t)ffilfe^*y 3 3Jcig»$*v.5^fig(ii 

«ffi^l4, CCDSIfe^^2(Oiifilf-^X«-ig^5o ¥ 
y 3 30f •CftlS^ttStfclSdS^rix^'HM'iS, 

5p'*y;i5ig:.s^&s. mt^iiti-^^mm^tt. 
3 4 A»e>a»iE«iiH!K 3 5 *5 ios;^'^ f^mss 3 

[0 0 3 5] mm^^^3 5Xit. mm^ihtz^^m^ 



5. ^mic^£m^titi-^^m^iB^im& 

mm^3 5i>^h^^ •yi'^^3 6(Di&:^<r)Atli^^-^m 

[003 6] z<D-mmmmxti. it^a^ 'o -g-fifew^ft 

■^«H:ft 1 0 « £JIT t *> *^ic:/J^ $ v > t * s^«e>^^ 
OT?. jSS«l(HlK3 5-e2»^miff5!e:>S:65fiV\ io 

[0 0 3 7] tt±;iSD-a-^ii«fB^oii^;6Si^6 
0&SiTttj:<9yh:^\,^Ztifi^lbi^ii-oX\,^^t%. 
:*:ttra(ilK2 5, 2 7:^<}:uqii||^|H]ig3 
X. m^fihPi^mmt. ie^m[HlK3 5(;lt3^^r, R 

ra(aIK2 5, 2 7*Sit5B«ilE}g[5I8g3 1 K*5^^r, P 

ioT. rwip*;^. ;^-1' -;/f^[HlK3 6-Ctt, 
lilK3 4A»b«i^$i^5jS»^«IS^lfiU•C^^«:^^■g■*l^|fe 

[0038] $ bic. tt±ij5 9 ^figHlfe«^WB^d5)fiSj 

Jfc:*:«F^lHlSS2 5. 2 7*jJ:otiilfe^jg|HlgS3 l 
*J^^•C, R18!3Em$ixfc4*lig«**. ii5«^f37-f /u^' 
3 7-.#t^$*i5, fcfc*U> JStt. -t-^iptji^S (-9 
0^~+9 0S) !i»e>il5$'^w^«*:»tttff5, rtnc 

3 4 *>P>^fti^$h,5iS^IEi^lSrlfi^TV^Ji^^^•g•fi^iii«ffi^3• 

[0 0 3 9] ZcDX^icLX. y^^^3 6X-mi}i 
iiS. K«3IP7^/p^'3 7-CH:, tti^$^^fc-g■^B« 

3 7tt, HBF W:/-;^ d»e>fl}*$H 

[0 0 4 0] znjioic. ^^!:®•a•fc■&4r^t5B^fe«^ 
14, »jJ:Br'*>»)Sv>t;:ffipsr*-t-«. aStroB 

^fi-^®/-f'X(±, y>VJ^XhoXtSmi)^f£^\ figo 
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[004 11 r T^tm^:^ * y 2 2 

msfisift^Sriate s/ 7 r p< ^ y 2 3 icsot^m 

^^lEfii-SiplcLTv^Si^ A;^li^p«*y 2 2*3 
it;/^y7rp<*y 2 31;:, nfSimm'O^b 2i^<om 

(100%) «rj@;i/iV^rtiS^fe^>>i^-5TV^5^. 

[0 0 4 21 ±a*LfcA:*B«p<*y 2 2*3j;t)t^<3'7 
r ^ * y 2 3 oH^f-^ Xfl, if ^ f> t> A;^®^© i ft 

i>+af:U-Ctai/\ mx.ii. a = 0. 2(Dm^^ t.^ 

mmti 7 6 4 1 * 0 , mmmmi^ 5 7 e t its. aj^ih 

I6<?«*y 2 2fcJ;t;>'^s'7r-^*y 2 3©lB«fl^oif 
yhS:!*, if*>e.fcA;^iil6il^CT?m\ Wx-lf, 8 

[0 0 4 31 ffi;^H«P<*y 3 3©iS«f--1'X 

li, A;^H^oift5>i: Lrt>Sv\ ffl;'3B^^*y3 

li, SDS i-*iii{|lfS^J-©tfc»AS 1 6 tlt<c b 1 2 tf 5/ h X 

3fet/<et), 6 4tt!5re> 1 4 t*y hx 3fei:?i5<^-C% 
1 6 tf y hx 3ferotfy hSciJs&itfi, 2 5 6ft©lil8i 

[0 0 4 4] CWtt, ^ihL.fcffi¥<|:|C(S)(fr¥J«P*> 
r-y^-r v'^/i'* p< 7©fSl t Sr±T£*(clt)*^ Lf£i)> bit 
^•rs, L-C, 1 2t6:»ii«im^A5ii;^Six-cv^ 
lasjc^-f J;5lc, ffl;^Bf6^*y 3 3tc, 1 
t!cB®®«ft#, 2«:sroB^ff-^, 3ft@oiJ«ft 

• • *3J:U!1 2ftB©li««^ASJu»$4x. 12 
18Six5. g|3AH:. * y 3 3 X-efc 

EI3Btt. CCD»^^^2}i»P>ffi;*»^Fh-5f--l'X 
T-$>5„ K 2, 3, • • fcit/l 2co^!?^ 

[0 0 4 51 rr-e, ^>Vf--Y~-\-^m4\z^ 
114 Atc^-fipic. '>-rs'^' 1 o^sff^nrv^s 

^, ii4B(c^-ri;eitc, ccDmiMLm^2i)^h»±m 

y 2 2lcEtS$tlS, ^tLT, g|4D(C^-fip 
3lciHm$fu5. 

[0 0 4 61 ^UT, A;^H«p«*y 2 2{Ciil6ft-^P 
2;isgse$ix, /<s/7rp«*y 2 3JcSi&fi#P l iS|2 



P 2 KMLXm^^^P 1 ®^i0^5«|ffl$J^5, 04 E 

-fe>Lffi^iE)es3o^^$tv, B«K3E^%»B«K^ 

[004 71 04 FiC^-r i P {C, ^OMWiSSf-S^ 

v^r, iiiii-f e>LttKiHigS3 0*5j:t5®«SjgiagS3 1 
jc*3v>r, H«ft^ic«iaASffi$*ia. -eur, 04 g 

o«iaiiig«ofiafie5^{cs<5v>ria;^Bffe^^-y 3 3^^ 

[00481 1 OSril-ri, Sf U^B«iSrIS!9 

atfCtSr±*, ffi:*B«p'^y 3 3 0ffiSr^D»$4^fc 

5. iiS?«jfed5ii^5tvfcBMa^i4, ia4Hic*-rj;5 
(c, Mimmy-f ji-^ 37 ^mmu s/n<ds<, b 

[0 0 4 9] Crr% rro^l^?JSjiffl$ttfc^20§lffi 

u i<Dm.m&^v&-ti>, ^^-f s'^iaK4 i-ef±, 

= V9fc^*n5®«*aail8S4 4Ji»e)W;^$*t,5^« 

-g-fifeBlfem^* fcHBIitft^tt. £EiffilHl8S 5 J; OSy^'C 

[00501 ^'T yf-IeIK4 2 T'tt, #3ilHlK 7 -CS^ 
$h<5-g-fi8B^ft-§-*fctt®««-ti:, ;^'l'yf^[iIK4 
1 4:^UT«i!e*ix5^^Bife«-^*fc«:HI6ffi^id» 
b{5JHd^loiS3l«?$it5, SW^Hfc-g-^BIfeffi-f-* 
fc(4B^ft-§-|±, ffi;^)4Sg^^4 3Sr:frLT^1-SC<^^=^C 

[0 0 5 1 1 #3SlHiK7*>5>ffl;^$tl5a«®B 

^ffi^tt. B»«iailB4 4*5<tt)5f'-^?3f^|5]K4 5-- 

ttij&^nso B^fe^a!a^^^s4 4-ei4, ±j$LfcB#te3SiHi 
K3 1 i^cj; 5 jfcBlfeiaaasy 7 h !>a:rjrTi£*tL 

5, 7*-^^«illIK4 5-Ct4, W;^jffi^4 6^J::frLr^ 

(0 0 5 21 ;i®J;5f-, ntt©Blft<i-^dS«»tl^^ 

{w^TiEii««:6lc|Bii$ti,5, = V 9 f B^feS 
^'fiom^. ±5&Ufc02©Bifc*aaiHlK(D::^ny^'ia 
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[0 0 5 3] crr% ii^ft-^-Sr¥ffi*^?5nfi--^#^-r 
[0 0 5 4] •tr-e. ±i$Lfca::*:ffiraiiI8S2 5*3j;Ot 

X = ( t - (tmax- 1) /2) • 
y= (v— (vmax— 1) /2) • 

[0 0 5 7] a*P lSria6Broj;5l-*«)*i:, 
Pl=7t/2-x (3) 

[0058] j^Qltt, 
Ql = t an"^ (y/L) (4) 

[0059] (1) , ^ (2) , s: (3) . s; (4) 
tt. •ffiSccDE^ (t, v) \z.n^<t^-f3^ (PI, Q 
1) S:*»S*ifeSr*LTVN5, (PI, Ql) 

(0;^|PliJ5h-vJFffii:3SiDSM^ (h4, v4) tt. 
h4 = L/t an (PI) 
v4 = L'tan (Ql)/sin (PI) 

[0060] Z.<OWm (h4, v4) tCCDSHfetlt^ 

(i, j) i^ll^fi, 
i = ( h 4 • tmax/LH H-tmax— 1 ) / 2 
j = ( V 4 • vnax/Ly +viBax— 1 ) / 2 

[00 6 1] rjxe<0^tt. (PI, Ql) lC*fjS 

f 5 c CDSI&^^±(0ffi««rSlifc{cfi:3gUfc-ifii ( i . 
j) Sr^«)5S;-efc5, S» (t. v) =&-¥-;tT^lRl 
(PI, Ql) Sr*fe, $e>(c||» (i, j) 35S**o 

l\ roffiSrRISM^cO;^ (t, v) (^y'-^J'i-rs, 

5.t5i-^tft*2iHifT5i6:>iii4ii<, l[H]o^mf^T? 



[0 0 5 5] ioT, SJMi^«^i:mii«Sitt^i:<ott 
S«IW«rfT5^, li«HS-^lc*fL-CRii3Eift&K6l-. 
rwy'^iJ^/w^y 7-C«L. E6BlJ:^-f-J;5I^L (m 
m) (OEil®h-viFffi*SLH XLy o"^^ ^-r^WLii^ 
iplc/ioTV^-S. r<03ti®'Srii5-ML (mm) cDRfSiS 

y^m ti-h me A) . rtuSrSStmaxXviiiaxOffli 

Hkom^ (t, v) ic^mi-^ mec) . 

[0 0 5 6] t, vSrS5:«>5t^rtilc*rjS:-t-Sx, y 

( 2 • 0 „ /tmax) ( 1 ) 

(2 • Ly /vmax) (2) 

[00 621 07 {C^l-J: 5 ^-f 90« 

^iSriSj^COtcii X, y, z©MS^SriaciJ;5l-* 
»5, *.;feiEfif [m) (Ofi:@tli|fe¥ffiGi)5fc5, ® 
«±©;^P«:. &^«c¥ffiH±©^Q^SiSi^§*t,5<, « 

[0 0 6 3] »]^$i^fcH^lco^^T, 
d X : x:*|Rl<Z)liljff-'f X Cm/pixel ] 
d y : y1j[fii<OM^-^^^ (m/pixel ) 
5 ' : x;*rp)COfiH (pixel ] 
Jj' : y:*^rS]«ficM (pixel ) 

[0 0 6 4] ^^^ix±mm'^^^X. 
e X : x;6'[B)«)lj^f--l'X (m/pixel ] 
e y : y*l^<Dl}?)f1>->f X (m/pixel ] 
€' : x:^\^<D^m (pixel ) 
n ' : y :*^lRlWfl:B (pixel ) 

[0065] liife±©^P tt. 5 {c«-t-r t As-c 

[0 0 6 6] 

[1^1] 

P = jj-dy 
. -/ 

[0 0 6 7] ^P(cm-r5»^ft:±©;^QSr 
[0 0 6 8] 
[ic2] 



[0 0 6 9] ^i"^^. .«SP*5j:t/;SQ«:-BB_tlc:fe 
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[0 0 7 0] 



DP = kW 



f dx 
V dy 
I -/ J 



r 

L «Q 



[0 0 7 1] zmmi)^h 

k=- f /z q 



xq 
zq 



[0 0 7 2] 
[iC4] 



zL 

dx 



29 



[0 0 7 3] ^m«<^H»±<^fi[Br *5<fct^7j' jji^b 

[0 0 7 4] 
[%5] 



05 = 5e + S5 



. 0 J 



= OC 



[0 0 7 5] Rft, x>f :i^i5^/l-:«7^7<7)||^Sr«-rOtT 



[0 0 7 6] 
[^6] 



R 

[0 0 7 7] rr-C. 0. 



COS0 0 -Jiin^l ri 

0 1 0 0 

Lsin^ 0 cosdJ Lo 
(PAN) 



0 0 

(T I LT) 

[0 0 7 8] 
[«7] 



fcosp — sinp 
sinp cosp 

Lq 0 
(ROLL) 



tcos^ cosp - sin0 sin^ sinp' 
^cos^ sinp - sin^ sin^ sinp 
sin 5 



L 0 

[0 "I rcos0 sin pi 

1 = COS0 cosp 

0 J L-sin^ J 



[0 0 7 9] b^i^^ 

[0 0 8 0] £X±oSlfe(cS<5v>rf^ofccmf&t-J:^ 

Z.<D')mmSk(D'fu :&-^p a [deg ) 

L. ±-^q a [deg ] h L. S^ttlnll^ Id r a [de 
g] a-/WLTSJ^LfcHlfe«r. jEB«rfp]V>T«]^ Lfc 
ll&m^^l^-¥®±(-^^1-^^0-C^5o 010 

[0 0 8 1] i^^mm<omm^m-:>%i5Vf(D^m(Dfy^ 

itT«J^Lfc:-0!ISriai 1 Ic^-fo 
S^lfl. 5 2 (degpp ] -efe^o ^1 1 Afl. x>f>?^ 
/^;<7y y-T^jES^-SJ^Lfcli^ft-^-efe^o HI IB 
fl. gji 1 A{w^i-jE®35>e)7^>fv^i5'/^;«7 7«7^;fe^2 



0g/^•:xLT!8^LfclI^fS^T*^5o mi ic[t. m 
1 1 A^c^•rJEffi;5^e>x^v^^/^;^7p<7^±^2 0Sf• 
/^hLrSJ^Ufc®««-g'-C&'5o 01 IDtt. 01 1 
A (c^-fE® hf^i^^/yy:^:^y^ ^IHhI 2 0 S 

1 A{C^-r:iEffi;&^e>7'^i^i5^y^;<?;<7«r^^2 OS^z-^V 
L> ±-^2 oa^/uhLr«]^L;rc®Mi^'C*)5o 0 
iiFJt. 01 lA\C7f^^^'^t^hy'^\y^;^io?f^y^ 
:fe--2 0«/^:^L. ±--2 0fi^/uhL. ^tf(Hl9tc:2 

[0 0 8 2] ±3^Lfc0 8*3j:t/0 9lC^"f3ttt^g^«?^ 
>^n ^7i^T*0 1 1 AJc^-rjEffiOii&m-g-i:l^-¥ffi 
(;:^tftLfc-'WS:01 2^^^-*-, 01 2A(i. 01 IB 
tC^-rif»«^S:*tt^«|Lfcli^ft^r*fe$o 012 
Bfl. 01 lClOT^i-li^ft^^3fe#^lftLfclj^fi# 

r**)So 0 1 2 cfi. 0 1 1 Dtc^i-HMi-^^^W^ 
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4:1 2 0%t:i®JKLTV^'5/ci?). E:^l?g^C3feoTV^* 
[0 0 8 31 CO<t5ti:. ±3SLfcl£;'c*M(HlK2 5*5 

[0 0 8 41 

[«?g 0^:11 r<^BI^(c:fttL«, 1/1 0 0 Osec <^ 
[0 0 8 51 XoX. T^7^>f:/y9XA^ybfiS^7 h 



[0 21 ^(D^mm^^fi^mmkmM&(r^-m<r>zf 
^^mm-i-^fz^o^^^mxh^o 

[El 41 CO||fig>SrlftW-r'5/b4e>Oi5'>r ^>'i/^^--h 
[051 :L<o%mtmm^fi^i^:^y-WmT>(^J^;v 

[061 z.(r>^m\mm^^^¥\m^^(Dmm\m^^h 
fi^^mxh^o 

[071 roiiKi^igfflsti.s3tttS»<^SiMicffiv^e> 

[081 :i<o^m\zmm^fi^%mt9k(or;\^^]}:<J:>^ 

(o-mxh^o 
<o-mxh^o 

[0101 ^(0|gWtcigffl$4x53t«i3?*OBttMJcfflv> 

hfih^imxh^, 

[0121 c:<^5IK{ciiffi$tt^5fett^lftoKMicfflv> 

1 . . • U:^X», 2 • • • CCD»ft^^. 3 • • • 
m^SlHlK. 4 • • -Utl^^I^x 5 • • -lEffilHl 

6 • • • IBSiii*:. 7 • • • #5ilHlK. 8 • • • ^ 
Tf^M^s 9 • • • 3 1 0 • • • i^-r ^ 



[011 



[031 





1 2 a 
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im2] 



m7] 



22 



29 

1 



30 



uxmm I «*Mn 



28 



31 

± 



[@4] 



32 j""" 



3 



mm 



A 1'^-^ 

B CCD 

F tin- x» 



I PI I P2 I P3 I P4 I 

I PI [ P2 I P3 I P4 [ 

I I P2 I pa I p< I 

t t t t 

PlOttS P2«HtS P4a)m 



PI ' I P2' I P3' I P4' I 



I PI' |PT+P2' |p1^*Py*P3'|p1'"«P4'|" 



[US] 
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[136] 



[01 0] 




ma] 



void h6iman3t 0 I 









w 


/' thh M^mn 


[degp-O] 






" pa SJt 


[deg] 




on 


/' qa Iftft 


[deg] 






1/ ra lai^ 


[deg] 










i ft 










w stl 








" hsizc 




[pixel] 


640 


fr vsize 




[pixel] 


480 










ir st2 








/' hwaku 




[pixel] 


768 


tr wfaku 




[pixel] 


578 


double cp , sp , cq , cr , sr , 1 ; 






double X , y , 


z , k1 , k2 , k3 . k4 , kS , k6 , kg . j 


■ J ; 


int h , V . hi . 


v1 . h2 . v2 : 







I = hsize / 2 / ten ( thhVed ) ; " 656.097 
" sin t cos **A-C*J<o red ttT[deB] ^fcyG)ft«[rad] ( =;r/ 360 ) 

CP = cos C paVad ) ; // 0 93989 

sp = -Bin ( pa*red ) ; " -0.3420 

cq = cos ( qa'rad ) ; ff 0.93969 

sq = -sin ( qa*rad ) : ff 0.342020 

cr = COS ( ra*rad ) ; " 0.93969 

sr = sin ( ra^rad ) ; » 0.342020 
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[09] 



k1 = cp*cr - sp*sq*sr ; " 0.92303 

k2 = cp*sr: rr 0.32139 

k3 = op'sr - sp'scfor ; " -0^1147 

K4 s cq*cr : " 0.86302 

k5 = -sp*cq: « 0.32139 

k6 = -sq ; /' -a342O20 

K9 = cp*cq / ga ; " 0.M3Q2 

» zzv ga 1 .0 fzi^9xhmzmffz. ^ = 0.2 tr^t. itxmmmomm^ 1 / 25 (- 

h2 = hwaku / 2 ; » 384 

v2 = wvaku / 2 : '/ 288 

pt2 = Bt2 + ofs ; « ai*BJi<o*»7-f >fl> *a 

for ( V = 0 : v<vwaku : v + + ) i « :f3S»© :^-f > ICOL^T 

v1=v-v2; '/ ^^^iSittii. 

for ( h = 0 ; h<hwaku ; h + + ) ( '/ j^tMkO) 1 ^-f>0)^Hai(--3l^T 

h1=h-h2; " ^i^Witktth. 

j< = ky(hni1 +v1'k2); u frWtO « . y . z 

y = k9*(hl*k3 + v1*k4): 

z = H + k8*(h1*k5 + v1*k8); 

i = hsize / 2 - Tx / z ; " x . y . z />>t»A^fiIflfta3<ftiE i J ^ ^<St)^o 
j = vsizo / 2 - l*y / 2 ; 

hirei2 ( sti ofs , i , j , haize , vsize ) ; 

I 

) 

) 



7nV h^— S^Oggt 

F^— 2H059 AA02 AA18 

5C022 AA13 ABOl AB68 AC32 AC42 
AC69 

5C024 AAOl CAll CA12 DA04 FAOl 
GAll HA08 HA17 HA19 HA24 

5C053 FA08 FA27 GB36 KA04 KA22 
LAOl 



-14- 



This Page is Inserted by IFW Indexing and Scanning 
Operations and is not part of the Official Record 



Defective images within this document are accurate representations of the original 
documents submitted by the appHcant. 

Defects in the images include but are not limited to the items checked: 



□ IMAGE CUT OFF AT TOP, BOTTOM OR SffiES 

□ FADED TEXT OR DRAWING 

□ BLURRED OR ILLEGIBLE TEXT OR DRAWING 

□ SKEWED/SLANTED IMAGES 

□ COLOR OR BLACK AND WHITE PHOTOGRAPHS 

□ GRAY SCALE DOCUMENTS 

□ LINES OR MARKS ON ORIGINAL DOCUMENT 

□ REFERENCE(S) OR EXHIBIT(S) SUBMITTED ARE POOR QUALITY 

□ OTHER: 

IMAGES ARE BEST AVAILABLE COPY. 
As rescanning these documents will not correct the image 
problems checked, please do not report these problems to 
the IFW Image Problem Mailbox. 



BEST AVAILABLE IMAGES 




BLACK BORDERS 



